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We study a simple model for the evolution of the cost (or more gen- 
erally the performance) of a technology or production process. The 
technology can be decomposed into n components, each of which 
interacts with a cluster of d — 1 other, dependent components. In- 
novation occurs through a series of trial-and-error events, each of 
which consists of randomly changing the cost of each component 
in a cluster, and accepting the changes only if the total cost of the 
entire cluster is lowered. We show that the relationship between 
the cost of the whole technology and the number of innovation at- 
tempts is asymptotically a power law, matching the functional form 
often observed for empirical data. The exponent a of the power 
law depends on the intrinsic difficulty of finding better components, 
and on what we term the design complexity: The more complex 
the design, the slower the rate of improvement. Letting d as de- 
fined above be the connectivity, in the special case in which the 
connectivity is constant, the design complexity is simply the connec- 
tivity. When the connectivity varies, bottlenecks can arise in which 
a few components limit progress. In this case the design complexity 
is more complicated, depending on the details of the design. The 
number of bottlenecks also determines whether progress is steady, 
or whether there are periods of stasis punctuated by occasional large 
changes. Our model connects the engineering properties of a design 
to historical studies of technology improvement. 
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The relation between a technology's cost c and the cumu- 
lative amount produced y is often empirically observed 
to be a power law of the form 



c{y) oc y 



[1] 



where the exponent a characterizes the rate of improvement. 
This rate is commonly termed the progress ratio 2~^, which 
is the factor by which costs decrease with each doubling of 
cumulative production. A typical reported value [9 is 0.8 
(corresponding to a ^ .32), which implies that the cost of the 
200th item is 80% that of the 100th item. Power laws have 
been observed, or at least assumed to hold, for a wide variety 
of technologies [21 [l8l [9] , although other functional forms have 
also been suggested and in some cases provide plausible fits to 
the datcQ We give examples of historical performance curves 
for several different technologies in Fig. 1. 

The relationship between cost and cumulative production 
goes under several different names, including the "experience 
curve", the "learning curve" or the "progress function". The 
terms are used interchangeably by some, while others assign 
distinct meanings [9] [29]. We use the general term perfor- 
mance curve to denote a plot of any performance measure 
(such as cost) against any experience measure (such as cu- 
mulative production), regardless of the context. Performance 
curve studies first appeared in the 19th century [10 , 6 , but 
their application to manufacturing and technology originates 
from the 1936 study by Wright on aircraft production costs 



31] . The large literature on this subject spans engineering 
23] , economics [Sj [29], management science and public 
policy [30]. Performance curves have been constructed for 
individuals, production processes, firms, and industries 9 . 



The power law assumption has been used by firm man- 
agers [12] and government policy makers [30] to forecast how 
costs will drop with cumulative production. However, the po- 
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Fig. 1: Four empirical performance curves. Each curve was 
rescaled and shifted to aid comparison with a power law. The 
X- and y- coordinates of each series i were transformed via 
logx ^ ai -\- bi logx, logy ^ d -\- di logy. The constants a^, 
bi, Ci, and di were chosen to yield series with approximately 
the same slope and range, and are given in the Supporting 
Information. Tick marks and labels on the left vertical axis 
show the first price (in real 2000 dollars) of the corresponding 
time series, and those of the right vertical axis show the last 
price. Lines are least-squares fits to a power law. Percentages 
are the progress ratios of the fitted power laws. Source: coal 
plants [14] , ethanol [I] , photovoltaic cells ^ij [28| [l2| , transis- 
tors [I9l. 
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^ Koh and Magee ' 15II16I claim an exponential function of time (Moore's law) predicts the perfor- 
mance of several different technologies. Goddard |11| claims costs follow a power law in production 
rate rather than cumulative production. Multivariate forms involving combinations of production 
rate, cumulative production, or time have been examined by Sinclair et al. |26| and Nordhaus |22| . 
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tential for exploiting performance curves has so far not been 
fully realized, in part because there is no theory explaining the 
observed empirical relationships. Why do performance curves 
tend to look like power laws, as opposed to some other func- 
tional form? What factors determine the exponent a, which 
governs the long-term rate of improvement? Why are some 
performance curves steady and others erratic? By suggesting 
answers to these questions, the theory we develop here can po- 
tentially be used to guide investment policy for technological 
change. 

A good example of the possible usefulness of such a theory 
is climate change mitigation. Good forecasts of future costs 
of low-carbon energy technologies could help guide research 
and development funding and climate policy. Our theory sug- 
gests that based on the design of a technology we might be 
able to better forecast its rate of improvement, and therefore 
make better investments and better estimates of the cost of 
achieving low-carbon energy generation. 

There have been several previous attempts to construct 
theories to explain the functional form of performance curves 
20 , 4, 13 . Muth constructed a model of a single-component 
technology in which innovation happens by proposing new de- 
signs at random. Using extreme value theory he derived con- 
ditions under which the rate of improvement is a power law. 
An extension to multiple components, called the production 
recipe model, was proposed by Auerswald et al. [i]. In their 
model each component interacts with other components, and 
if a given component is replaced, it affects the cost of the com- 
ponents with which it interacts. They simulated their model 
and found that under some circumstances the performance 
curves appeared to be power laws. 

We simplify the production recipe model in order to make 
it more tractable. This simplification allows us to derive the 
emergence of a power law, and in particular, to derive its ex- 
ponent a. We obtain the result that the asymptotic rate of 
improvement is independent of the total number of compo- 
nents n. Instead we find that a = l/{jd*), where 7 measures 
the intrinsic difficulty of finding better components and is 
what we call the design complexity. When the connectivity 
of the components is constant, the design complexity is equal 
to the connectivity, but when connectivity varies, it can also 
depend on the detailed properties of the design. We also show 
that when costs are spread uniformly across a large number 
of components, the whole technology undergoes steady im- 
provement. In contrast, when costs are dominated by a few 
components, it undergoes erratic improvement. Our theory 
thus potentially gives insight into how to design a technology 
so that it will improve more rapidly and more steadily. 



The Model 

The production design consists of n components, which can 
be thought of as the parts of a technology or the steps in an 
industrial process]^ Each component i has a cost d. The 
total cost c of the design is the sum of the component costs: 
c = ci + C2 + • • • + Cn. A component's cost changes as new 
implementations for the component are found. For example, a 
component representing the step "move a box across a room" 
may initially be implemented by a forklift, which could later 
be replaced by a conveyor belt. Cost reductions occur through 
repeated changes to one or more components. 

Components are not isolated from one another, but rather 
interact as parts of the overall design. Thus changing one com- 
ponent not only affects its cost, but also the costs of other de- 
pendent components. Components may be viewed as nodes in 
a directed network, with links from each component to those 
that depend on it. The relationship between the nodes and 
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Fig. 2: Example dependency structure matrices (DSMs) with 
n = 13 components. Black squares represent links. The DSM 
on the left was randomly generated to have fixed out-degree 
for each component. The DSM on the right represents the 
design of an automobile brake system [24 . All diagonal ele- 
ments are present because a component always affects its own 
cost. 



links can alternately be characterized by an adjacency matrix. 
In systems engineering and management science this matrix 
is known as the design structure matrix or DSM 27, 25, 5 . A 
DSM is an n X n matrix with an entry in row i and column j 
if a change in component j, the modifying component, affects 
component i, the dependent component (Fig. 2). The matrix 
is usually binary [51 [24]; however, weighted interactions have 
also been considered [7]. DSMs have been found to be useful 
in understanding and improving complex manufacturing and 
technology development processes. 

We begin by considering the simplest case of fixed out- 
degree, or equivalently constant connectivity, in which each 
component affects exactly d components: itself and d — 1 
others. The dependencies between components are chosen at 
random with equal probability. Cost reductions are realized 
through the following series of innovation attempts: 

1. Pick a random component i. 

2. Use the DSM to identify the set of dependent components 
Ai = {j} whose costs depend on i. 

3. Determine a new cost Cj for each component j G Ai from 
a specified probability distribution /. 

4. If the sum of the new costs, Cl = X^^^^. Cj, is less than the 
current sum, d, then each Cj is changed to Cj. Otherwise, 
the new cost set is rejected. 

The costs are defined on [0,1]. We assume a proba- 
bility density function that for small values of Ci has the 
form f{ci) (X c7~^, i.e. the cumulative distribution F{ci) — 
Jo'' f{c)dc oc c] . The exponent 7 specifies the difficulty of 
reducing costs of individual components, with higher 7 cor- 
responding to higher difficulty. This functional form is fairly 
general in that it covers any distribution with a valid power- 
series expansion at c = 0. 

Independent Components 

Let us first consider the process with a single component, as 
originally studied by Muth [20 . The generalization to n inde- 
pendent components is trivial, and only affects the constant 



The original production recipe model contained 6 parameters. The following simplifications were 
made to produce the model in this paper: Length of production run T oo. Output-per- 
attempted-recipe-change B — > 1. Available implementations per component s oo. Search 
distance 5^1. 
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Fig. 3: Simulations of single realizations of the model for var- 
ious numbers of components n and design complexity d* = d, 
using DSMs with constant d. The plots are for n = 10, 30 and 
d = 1,4. The solid curves represent Eq. ||5|. 



of proportionality. Letting t represent the number of innova- 
tion steps, the cost at time t is equivalent to the minimum 
of t independent, identically-distributed random variables. In 
the Supporting Information we show that the exact solution 
when 7 = 1 is 



c{t) 



1 + t 



[2] 



We now present an intuitive derivation that gives the right 
scaling but underestimates the amplitude. At each innovation 
attempt a new cost c is drawn uniformly from [0, 1], and a 
successful reduction occurs if c is less than the current cost 
c. Since the distribution of new costs is uniform on [0, 1] the 
probability Prob(c^ < c) that c represents a reduction simply 
equals c. When a reduction does occur, the average value of 
c equals c/2. In continuous time the rate of change of the 
average component cost is 



dc 
di 



(^1) X Prob(c < c) 



1 2 



[3] 



The solution to Eq. (jsj gives the correct scaling of c(t) ~ 1/t 
as t ^ oo. One way to view this result is that cost reduc- 
tions are proportional to the cost itself, leading to an expo- 
nential decrease in cost with each reduction event; however, 
each reduction takes exponentially longer to achieve as the 
cost decreases. The competition between these two exponen- 
tials yields a power law. Muth's result is an application of ex- 
treme value theory, in which the mean value of the minimum 
of m independent and identically distributed random variables 
evolves as a power law in m when the variables are drawn from 
a distribution with a power-series expansion around zero. 

Interacting Components, Fixed Out-Degree 

Now consider an n-component process with fixed out-degree, 
where each component affects exactly d — 1 other, depen- 
dent components. Following steps similar to those that led 
to Eq. |[3| , let c(t) denote the current total cost of all compo- 
nents. The average change in c due to the next improvement 
is given by summing over all changes that result in a new 



cost c < c, and multiplying the changes by their respective 
probabilities: 



(Ac) « - /%(c' 

^0 



)(c — c) dc . 



This integral is performed in the Supporting Information. The 
average change per timestep is 



dc 
di 



-Kc 



,7d+l 



[4] 



where 



if=idT<*+S''r[B(7,i7 + 2), 
and B(j)^ q) is the Beta function. The solution to Eq. ||4]| is 
c(t) = c(0) (^^ + l) "\ [5] 

with to = [Kc(0)^S^^]"^- 

We compare our prediction in Eq. (jsj to simulations in 
Fig. 3. Initially each component cost d is set to 1/n, so 
that the total initial cost c(0) = 1, and we arbitrarily choose 
7 = 1. Our theory correctly predicts the asymptotic power 
law scaling of the simulated performance curves. Furthermore 
our theory predicts an initial downward concavity that lasts 
for a time to; this prediction is accurate for small d (but for 
large d it underestimates the concavity) . As given by Eq. ||5]|, 
increasing the number of components n extends the duration 
of the initial concavity. 

The above asymptotic solution for c(t) is consistently 
somewhat larger than the average value in the simulation. 
This discrepa ncy stems from the approximations involved in 
deriving Eq. Q . In the Supporting Information the average 
cost is deriveoDy other methods that compute the distribu- 
tion. These calculations yield the correct amplitude but only 
apply in the limit t ^ oo. 

The salient result of this section is that the exponent 
a = 1/ (7^) of the performance curve is directly and simply 
related to the out-degree o?, which can be viewed as a measure 
of the complexity of the design, and 7, which characterizes the 
difficulty of improving individual components in the limit as 
the cost goes to zero. If 7(i = 1 then a = 1 and the progress 
ratio 2"^/(^^^is 50%. If 7(i = 3 then a = 1/3 and the progress 
ratio is approximately 80%, a common value observed in em- 
pirical performance curves. 



Interacting Components, Variable Out- Degree 

When the out-degree of each component is variable the situa- 
tion is more interesting and more realistic because components 
may differ in their rate of improvement [24 . Slowly improv- 
ing components can create bottlenecks that hinder the overall 
rate of improvement. To understand why such bottlenecks oc- 
cur it is important to realize that the rate of improvement of a 
given component depends on all the clusters Aj of which it is 
a member. (Recall that Aj is the set of components affected 
by j.) As illustrated in Fig. 4, there are two ways to reduce 
the cost of component i: 

1. Pick i and improve cluster Ai. 

2. Pick another modifying component j that affects i and im- 
prove cluster Aj. 
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Fig. 4: A component i (shaded circle), together with the de- 
pedent components Ai that are affected by i (dotted elhpse) 
and the modifying components that affect i (dashed ehipse). 
The arrow from j to i indicates that a change in cost of com- 
ponent j affects the cost of i. 



As we shah now show, the hmiting rate for the improvement 
of a given component i is determined not only by the out- 
degree of the component itself, but also by the properties of 
the clusters Aj of the modifying components that affect it. 

First consider process (1) in which component i is picked, 
corresponding to the dotted ellipse in Fig. 4. Let d — 
^k^A - costs of the di dependent com- 

ponents in Ai. Since di new costs are drawn independently 
at each time step the generation of new costs is equivalent to 
picking a point with uniform probability in a cZj-dimensional 
hypercube. The combinations of component costs that reduce 
the total cost lie within the simplex defined by J^^.^^. c'^ < Ci, 
where are the new costs. The probability of reducing the 
cost is therefore the ratio of the simplex volume to the hyper- 
cube volume. 



Pi 



{Cl/d^^{nC^ 
{1/nYi di\ ' 



[6] 



which is a decreasing function of di. Thus a component with 
a higher out-degree (greater connectivity) is less likely to be 
improved when chosen. (This is essentially the reason why a 
decreases with d when the out-degree is fixed.) 

Let us now consider case (2) in which component i im- 
proves when another modifying component j that affects it is 
chosen (lying inside the dashed ellipse in Fig. 4). Any com- 
ponent j whose cluster contains i can cause an improvement. 
Let d^j be the out-degree of the modifying components j that 
affect i. Then the overall rate at which i improves is deter- 
mined by df^^^ = minj{(i*}, i.e. by the component j most 
likely to cause an improvement in i. The overall improvement 
rate for the whole technology is then determined by the slow- 
est improving component i. Thus the design complexity is 
more generally given by 



d = maxja^ j. 



[7] 



Note that in the case of constant out-degree d this reduces to 
= d. In every case we have studied a = l/{d*^) correctly 
predicts the mean rate of improvement when t is sufficiently 
large (see Fig. 5). 



properties of the DSM. In Fig. 5 we plot two individual tra- 
jectories of cost vs. time for each of three different DSMs. 
The trajectories fluctuate in every case, but the amplitude 
of fluctuations is highly variable. In the left panel the ampli- 
tude of the fluctuations remains relatively small and is roughly 
constant in time when plotted on double logarithmic scale (in- 
dicating that the amplitude of the fluctuations is always pro- 
portional to the mean). For the middle and right panels, in 
contrast, the individual trajectories show a random staircase 
behavior, and the amplitude of the fluctuations continues to 
grow for a longer time. 

This behavior can be explained in terms of the improve- 
ment rates d^^^ for each component. The maximum value 
of c/™^^ determines the slowest-improving components. In the 
left panel the maximum value of c?™^^ = 2. This value is re- 
peated four times. After a long time these four components 
dominate the overall cost. However, since they have the same 
values of d™^^ their contributions remain comparable, and the 
total cost is averaged over all four of them, keeping the fluc- 
tuations relatively small. (See the lower panels of Fig. 5.) 

In contrast, in the middle panel we illustrate a DSM where 
the slowest-improving component (number 7) has d™^" = 4 
and the next slowest-improving component (number 6) has 
^mm _ 2 With the passage of time component 7 comes to 
dominate the cost. This component is slow to improve be- 
cause it is rarely chosen for improvement. But in the rare 
cases that component 7 is chosen the improvements can be 
dramatic, generating large downward steps in its trajectory. 
The right case illustrates an intermediate situation where two 
components are dominant. 

Another striking feature of the distribution of trajectories 
is the difference between the top and bottom envelopes of the 
plot of the distribution vs. time. In every case the top enve- 
lope follows a straight line throughout most of the time range. 
The behavior of the bottom envelope is more complicated; in 
many cases, such as the left panel of Fig. 5, it also follows 
a straight line, but in others, for example the middle panel, 
the bottom envelope changes slope over a large time range. A 
more precise statement can be made by following the contour 
corresponding to a given quantile through time. All quantiles 
eventually approach a line with slope 1/d* . However, the up- 
per quantiles converge to this line quickly, whereas in some 
cases the lower quantiles do so much later. This slower con- 
vergence stems from the difference in improvement rates of 
different components. Whenever there is a dramatic improve- 
ment in the slowest- improving component (or components), 
there is a period where the next slowest-improving compo- 
nent (or components) becomes important. During this time 
the lower d™^^ value of the second component temporarily 
influences the rate of improvement. After a long time the 
slowest-improving component becomes more and more domi- 
nant, large updates become progressively more rare, and the 
slope becomes constant. 

The model therefore suggests that properties of the design 
determine whether a technology's improvement will be steady 
or erratic. Homogeneous designs (with constant out-degree) 
are more likely to show an inexorable trend of steady im- 
provement. Heterogeneous designs (with larger variability in 
out-degree) are more likely to improve in fits and starts. High 
variability among individual trajectories can be interpreted as 
indicating that historical contingency plays an important role. 
By this we mean that the particular choice of random num- 



Fluctuations 

The analysis we have given provides insight not only into 
the mean behavior, but also into the fluctuations about the 
mean, which can behave quite differently depending on the 



One problem that must be considered is that of resolution. As an approximation a DSM can be 
constructed the coarse level of entire systems, e.g. "electrical system", "fuel system", or it can be 
constructed more accurately at the microscopic level in terms of individual parts. In general these 
will give different design complexities. 
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Fig. 5: Evolution of the distribution of costs. Each figure in the top row shows a simulated distribution of costs as a function 
of time using the design structure matrix (DSM) in the lower left corner of each plot. The upper dash-dot lines provides a 
reference with the predicted slope a = l/{jd*), with 7 = 1; from left-to-right the slopes are —1/2, —1/4, and —1/4. The 
data for each DSM are the result of 50,000 realizations, corresponding to different random number seeds. The distributions 
are color coded to correspond to constant quantiles, i.e. the fraction of costs less than a given value at a given time. The 
solid and dashed black curves inside the colored regions represent two sample trajectories of the total cost as a function of 
time. The DSMs are constructed so that in each case component 1 has the lowest out-degree and component 7 has the highest 
out-degree. Below each distribution we plot the fraction of the total cost contributed by each of the 7 components at any given 
time (corresponding to the first simulation run). The components in Figs, (b) and (c) with the biggest contribution to the cost 
in the limit t ^ 00 are highlighted. The box at the bottom gives the value of d'^'^^ for each component of the design. 



bers, rather than the overall trend, dominates the behavior. 
In this case progress appears to come about through a series 
of punctuated equlibria. 

To summarize, in this section we have shown that the 
asymptotic magnitude of the fluctuations is determined by the 
number of critical bottlenecks, defined as the number of com- 
ponents that have the maximum value of d™^^. In the constant 
out-degree case all of the components are equivalent, and this 
number is just n. In the variable out-degree case, however, 
this number depends on the details of the DSM, which influ- 
ence c/™^^. The fluctuations decrease as the number of worst 
bottlenecks increases. 

Testing the Model Predictions 

Our model makes the testable prediction that the rate of im- 
provement of a technology depends on the design complexity, 
which can be determined from a design structure matrix. The 
use of DSMs to analyze designs is widespread in the systems 
engineering and management science literature. Thus, one 
could potentially examine the DSMs of different technologies, 
compute their corresponding design complexities, and com- 
pare to the value of a based on the technology's histor}j^ 

This test is complicated by the fact that a also depends 
on 7, which describes the inherent difficulty of improving in- 
dividual components, which in turn depends on the inherent 
difficulty of the innovation problem as well as the collective 
effectiveness of inventors in generating improvements. The ex- 
ponent 7 is problematic to measure independently. Nonethe- 



less, one could examine a collection of different technologies 
and either assume that 7 is constant or that the variations 
in 7 average out. Subject to these caveats, the model then 
predicts that the design complexity of the DSM should be 
inversely proportional to the estimated a of the historical tra- 
jectory. A byproduct of such a study is that it would yield an 
estimate of 7 in different technologies. 

To compare the model predictions to real data one must 
relate the number of attempted improvements to something 
measurable. It is not straightforward to measure the effort 
that has gone into improving a technology, and to compare 
to real data one must use proxies. The most commonly used 
proxy is cumulative production, but other possibilities include 
cumulative investment, installed capacity, R&D expenditure, 
or even time. The best proxy for innovation effort is a subject 
of serious debate in the literature [13 1^ ^0 ^] . 

Possible Extensions to the Model 

There are a variety of possible ways to extend the model to 
make it more realistic. For example, the model currently as- 
sumes that the design network described by the DSM is con- 
stant through time, but often improvements to a technology 
come about by modifying the design network. One can po- 
tentially extend the model by adding an evolutionary model 
for the generation of new DSMs. 

The possibility that the design complexity d* changes 
through time suggests another empirical prediction. Accord- 
ing to our theory, when d* changes, a changes as well. One 
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can conceivably examine an historical sequence of design ma- 
trices, compute their values of d*, and compare the predicted 
a ^ 1/d* to the corresponding observed values of a in the 
corresponding periods in time. Our theory predicts that these 
should be positively correlated. 

We have assumed a particular model of learning in which 
improvement attempts are made at random, with no regard 
to the history of previous improvements or knowledge of the 
technology. An intelligent designer should be able to do bet- 
ter, drawing on his or her knowledge of science, engineering, 
and present and past designs. While an accurate model of 
such a complex process is likely to be difficult, it is possible 
to alter the model here so that innovation attempts are rela- 
tive to the current design, rather than independent of it. This 
could potentially alter the predictions of the model. 

Discussion 

We have developed a simplified version of the model of Auer- 
swald et al. g], which predicts the improvement of cost as a 
function of the number of innovation attempts. While we have 
formulated the model in terms of cost, one could equally well 
have used any performance measure of the technology that 
has the property of being additive across the components. 
Our analysis makes clear predictions about the trajectories of 
technology improvement. The mean behavior of the cost is 
described by a power law with exponent a — l/((i*7), where 
dt is the design complexity, and 7 describes the intrinsic diffi- 
culty of improving individual components. In the case of con- 
stant connectivity (out-degree) the design complexity is just 
the connectivity, but in general it can depend on details of 
the design matrix, as spelled out in Eq. Q. In addition, the 
range of variation in technological improvement trajectories 
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depends on the number of critical bottlenecks. This number 
coincides with the total number of components n in the case 
of constant connectivity, but in general the number of worst 
bottlenecks is less than this, and depends on the detailed ar- 
rangement of the interactions in the design. 

Many studies in the past have discussed effects that con- 
tribute to technological improvement, such as learning- by- 
doing, R&D, or capital investment. Our approach here is 
generic in the sense that it could apply to any of these. As 
long as these mechanisms cause innovation attempts that can 
be modeled as a process of trial and error, any of them can 
potentially be described by the model we have developed here. 

Our analysis makes a new contribution by connecting the 
literature on the historical analysis of performance curves to 
that on the engineering design properties of a technology. We 
make a prediction about how the features of a design influ- 
ence its rate of improvement, focusing attention on the in- 
teractions of components as codified in the design structure 
matrix. Perhaps most importantly, we pose several falsifiable 
propositions. Our analysis illustrates how the same evolution- 
ary process can display either historical contingency or steady 
change, depending on the design. Our theory suggests that 
it may be possible to influence the long-term rate of improve- 
ment of a technology by reducing the connectivity between 
the components. Such an understanding of how the design 
features of a technology affect its evolution will aid engineer- 
ing design, as well as science and technology policy. 
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